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ABSTRACT 

We derive a formula for the nonequilibrium entropy of a classical stochastic field 
in terms of correlation functions of this field. The formalism is then applied to define 
the entropy of gravitational perturbations (both gravitational waves and density fluc- 
tuations). We calculate this entropy in a specific cosmological model (the inflationary 
Universe) and find that on scales of interest in cosmology the entropy in both density 
perturbations and gravitational waves exceeds the entropy of statistical fluctuations 
of the microwave background. 

The nonequilibrium entropy discussed here is a measure of loss of information 
about the system. We discuss the origin of the entropy in our cosmological models 
and compare the definition of entropy in terms of correlation functions with the 
microcanonical definition in quantum statistical mechanics. 
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I. INTRODUCTION 



The concept of entropy plays an important role in all branches of physics. Hence, it 
is no surprise that entropy can also be defined in general relativity and cosmology. The 
most famous application of entropy in general relativity is to black holes. Bekenstein's [1] 
realization that the area of a black hole behaves like an entropy led to the discovery of 
black hole radiation [2]. Other important applications of entropy in cosmology relate to the 
characterization of the initial state of the universe [3] and to the study of the post-bounce 
state in bouncing cosmologies. 

Entropy expresses the loss of information about the system under consideration [4] . Quite 
a long time ago, Jaynes [4] argued that entropy expresses the extent of human ignorance 
about a system and is therefore an antropomorphic concept. One can uniquely define entropy 
only after having specified the position of the observer with respect to the system. 

Once we accept that entropy measures the loss of information about a system, it becomes 
important to ask whether there is a natural "coarse graining" , i.e. can it be uniquely specified 
which part of the information about a system is lost? The problem of defining the entropy 
becomes the task of determining the correct coarse graining. 

We wish to address this question in order to define the entropy of the gravitational 
field. From a naive point of view, gravitational instability, which is responsible for the 
formation of structure in the Universe, should lead to an increasing entropy - in agreement 
with the second law of thermodynamics. In the initial state in which the gravitational 
field is (almost) uniform, the gravitational entropy (almost) vanishes. In contrast, the later 
state of the gravitational field which results from gravitational instability can be viewed 
as a particular realization of some stochastic process producing density perturbations and 
gravitational waves. Hence, there should be an associated entropy which characterizes the 
naturalness of the occurrence of the given distribution or, more quantitatively, measures the 
probability of the distribution. 

To characterize the measure of a state of gravitational radiation or density perturbations 
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in a quantitative manner, we need a well defined and well justified notion of entropy of 
gravitational perturbations. Since the states we are interested in are far from thermal 
equilibrium, our task will be to define an entropy for nonequilibrium systems in cosmology. 

There exists already a considerable body of work on the definition of nonequilibrium 
entropy, in particular in the context of cosmology. For example, Smolin [5] derived a formula 
for the entropy of a "quantum field" state of gravitational radiation and applied it to estimate 
the entropy of some astrophysical sources of gravitational radiation. 

In a series of paper, Hu and Paron [6], Kandrup [7,8] and Kandrup and Hu [9] have 
discussed the entropy of particles produced in an expanding universe. They gave a definition 
of entropy based on the single particle distribution function (density matrix) and showed 
that this entropy increases in time (if the initial state is free of correlations) as a result of 
particle production. This definition of entropy (and in particular the role of coarse graining 
and loss of correlations) was further discussed by Habib and Kandrup [10]. 

Some interesting speculations about the entropy S g of the gravitational field have been 
made by Penrose [3] and Hu [11], who propose that S g is proportional to the integral of the 
Weyl tensor squared C 2 over space. This definition expresses the expectation that metric 
fluctuations should give rise to entropy. With this formulation, Penrose's initial condition 
criterion [3] C — for the universe is equivalent to the assumption that the universe starts 
in a state of vanishing gravitational entropy. 

In this paper we use two quite different approaches to define the nonequilibrium entropy 
of cosmological perturbations. One of them is based on the microcanonical ensemble [12] 
of quantized gravitational perturbations while the other is a formula for entropy which 
can be associated with the stochastic distribution which describes the state of the classical 
gravitational field. We show that these two definitions are in agreement and discuss the 
physical meaning of the entropy of gravitational fluctuations. Then, we apply our definitions 
to estimate the entropy of gravitational waves and linear density inhomogeneities produced 
by inflation [13]. We also indicate how to apply our methods to other cosmological models, 
e.g., those based on phase transitions [14]. 
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Our analysis is based on the fact that the theory of gravitational waves and of linearized 
density perturbations in an expanding universe can be reduced [15] to the study of a real 
scalar field in an external classical background. Hence, we will investigate the more general 
question of how to define the entropy of a scalar field in a nonequilibrium state. We can 
either study the quantum theory of this field and use the microcanonical ensemble, or we 
can view the classical field as a stochastic process and determine its entropy. 

The paper is organized in the following manner: after some general comments about 
nonequilibrium entropy in section 2, we give in sections 3 and 4 the quantum and classical 
definitions of entropy. In section 5 we show the equivalence of the two definitions when 
applied to situations when both are applicable. We also demonstrate that the entropy 
is a result of coarse graining. In section 6 we briefly review the gauge invariant theory of 
cosmological perturbations upon which our definition of the entropy of the gravitational field 
is based. For a pedagogical introduction, the reader is referred to Ref. 16, for an extensive 
review to Ref. 15. Section 7 contains the main applications of our work: the evaluation of 
the entropy of gravitational waves and density perturbations in inflationary universe models. 

We use units in which H — ks — c — 1. Greek indices run over space-time variables, 
Latin indices only over spatial variables. 

II. NONEQUILIBRIUM ENTROPY 

We will first develop a general definition of entropy for a system far from thermal equi- 
librium, based on the microcanonical ensemble [12]. Let us assume that the state of some 
physical system can be completely described by a set of discrete variable J = {I,i,j, . . .}. 
If we know that the system is in a certain state J, then the information about the state of 
the system is complete and hence the entropy should be zero, as follows from the general 
definition of entropy in information theory according to which entropy means the loss of 
information. If, on the other hand, we only know the probability distribution Pj for the 
system, Pj being the probability to find the system in state J, then the associated entropy 
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is [4,12] 

s = -J2p.j^Pj (i) 

j 

Now let us assume that we are not interested in or cannot measure the complete (fine 
grained) state of the system, but only some coarse grained characteristics, e.g., the value 
of the variable I. The coarse grained state can be described by a distribution function P T , 
and the associated entropy is given by the analog of (1) where we sum only over the index 
/. This entropy characterizes the measure of solutions of the dynamical system which leads 
to the particular coarse grained state. 

If the variable J in (1) is continuous, some complications arise. If VJ is the measure on 
the space of state, then a probability density p(J) can be defined by 

VP(J)=p(J)VJ, (2) 

where VP {J) is the probability to find the system in the volume VJ around the state J. 
For example, in a system of n particles with Cartesian coordinates xi, . . .x n and momenta 
Pi, . . .p n , we would have J = (x 1 . . . ,x n ,p 1 , . . . ,p n ) and VJ = Y[i=i(dxidp 1 )- In a system 
with an infinite number of particles, VJ becomes a measure in the space of functionals. 

To derive the formula for the entropy of a system with continuous J starting from 
Eq. (1), we first divide phase space into sufficiently small cells Ji, J 2 . . . with volume elements 
A Ji, AJ 2 , The probability to find the system in cell n is 

P Jn ^p(J n )AJ n , (3) 

and hence from (1) the entropy is 

5= -£P/ n lnP/ n ^ -]Tp(J n )(lnp(J n )) AJ n -£p(J n )ln(AJ n )AJ n . (4) 

n n n 

This expression has no limit for AJ n — >• because of the diverging second term which in 
general depends on {p(J n )}. This terms represents the information about the process of 
coarse graining. 
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However, for a simple coarse graining with AJi = AJ 2 = . . ., the second term in (4) 
does not depend on the probability distribution P(J) and can hence be neglected as some 
irrelevant additive constant — In A J to the entropy. Note that in a quantum dynamical 
system, there is a natural choice A J = (2nh) n due to the uncertainty principle. We conclude 
that in the case of a continuous probability distribution, the entropy is defined by coarse 
graining and depends on the measure in the phase space of the system. Dropping the second 
term in (4) and taking the continuum limit A J — > gives 



Let us return to a system whose phase space is described by a set of discrete variables. 
Furthermore, we consider the case when the entire system consists of J\f identical subsystems 
(e.g., Af photons), each characterized by a discrete set of variable {I ,i, j, . . .}. We assume 
that there is some principal quantum number I which is completely distinguishable, i.e., any 
two states with different / can be experimentally distinguished, and that the other numbers 
correspond to different but experimentally indistinguishable states with the same 
value of I. As an example, for a gas of photons in a box we can take / to be the energy of 
a photon, and i, j, ... to correspond to different directions of motion. 

The source of entropy in the above setup is the loss of information coming from the 
indistinguishability of states with identical / but different i, j, . . . States labelled by / can 
be assigned a degeneracy gi which equals the number of microphysical states with identical 
quantum number /. 

Let us now assume that ni subsystems have the same principal quantum number /. 
For the moment we assume that the spectrum of the system {n/}, i.e., the number n I of 




(5) 



where VJ is the functional measure for the variable J. 



III. MICROCANONICAL DEFINITION OF ENTROPY 



FOR A QUANTIZED FIELD 
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subsystems with principal quantum number / (for all I), is fixed. Our goal is to calculate 
the number of possible microphysical states with a given spectrum which are in principle 
distinguishable. The calculation is done for systems with Bose statistics, e.g., photons, 
gravitons or scalar type cosmological perturbations. 

The problem reduces to calculating the number of possible and distinguishable ways in 
which nj subsystems can be distributed among gj cells. This number is 

Wn ' nr\( gi -l)\- W 

To obtain this expression, note that there are (n/ + gi — 1)! ways of dividing nj objects by 
gi — 1 cell divisions. However, both the particles and the cell divisions are indistinguishable 
and hence we must divide by fij\{gi — 1)!. 

For a system of Af subsystems with spectrum {n/} (obeying — A/"), the phase 

volume (number of possible states) will be 

r { ^ = n^- (7) 

The next step is to assume that all possible states are equally probable. In this case, the 
probability for any state a with the given spectrum {nj} is 

*W«) = tT~~ • (8) 
1 {«/} 

From (1) it follows that the corresponding entropy of the system with definite spectrum 
{ni} is 

S = -J2 P {n I }(a)^P {ni} (a) = \nT {ni} = £lnW^, (9) 

a I 

taking into account the normalization condition 

E*W(«) = i- (io) 

a 

If nj ^> 1, then Stirling's formula can be applied to approximate W ni in (9). In this 
case, the entropy becomes 
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S = 5> + !) ln K + 1) - nj In^] (11) 

7 

where rij —njjgi are the occupation numbers. 

All that was assumed in the above considerations is that the spectrum {n/} is well 
defined. At no point was thermodynamic equilibrium invoked. Hence, (11) gives a formula 
for the entropy of a statistical system with definite spectrum which is valid both in and far 
out of thermodynamical equilibrium. It is based on the microcanonical ensemble. 

The simplest application of this formula for the entropy is to a black body spectrum of 
photons with 

n * = ( 12 ) 

with j3 = 1/T and k — \k\. In this case, each photon is a subsystem. The principal 
quantum number I is the energy k, and the other quantum numbers . . . correspond to 
the directions of photon propagation. The degeneracy g% of level I = k is 

Att 

g k = —Vk 2 dk (13) 

where V is the volume of space. Substituting (12) and (13) into (11) we obtain the entropy 
density of the black body background 

S = ^~^T 3 . (14) 
V 3 K J 

In the above example, the origin of the entropy is the absence of information about the 
direction of propagation of the photons. 

If the spectrum {n/} is not well known, there is an additional source of entropy. Let us 
assume a probability distribution P({nj}) for different spectra. Note that even the total 
number J\f of subsystems need not be fixed. In this case, the space of all possible states is 
the direct sum of states for the different spectra {n/}. The probability to find the system 
in a state ee^y with spectrum {nj} is 

P(a {ni} ) = P({n I })- r ^rr, (15) 
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and (from (1)) the entropy will be 



S= "E E p ( a {nj}) lnP(a {fi , } ) 



{«/} a{m} 



= £ P({n/}) lnr({n i }) - £ P({n 7 }) lnP({n,}) (16) 




where stand for summation over all possible spectra {nj}. If the spectrum is com- 



pletely specified, then P({n/}) = 1(0) for {n/} = {n°}({n/} ^ {n°j}) and (16) reduces to 
(9). In the general case, there are two contributions to the entropy. The first term in (16) is 
due to the absence of information about the non-principal quantum numbers of the system 
for a fixed spectrum, the second comes from our ignorance of the precise spectrum. 

In the case of cosmological perturbations, the distribution function P({n/}) for the 
spectrum is well localized at a particular spectrum {n®} and hence 



However, there are examples where the second term in (16) gives the main contribution 
to the entropy. For example, in the case of a black hole it is impossible to have information 
about the spectrum of the configuration making up the hole, since this information is hidden 
behind the horizon. If W is the number of possible different spectra for a black hole of fixed 
mass, and if we assume that all of these spectra have equal probability, then, neglecting the 
first term in (16), we get 



If the black hole is quantized, then W is finite. In fact, counting the number of spectra of 
a black hole with fixed mass gives a formula for the entropy in agreement with the classical 
result [17]. 

Let us return to the discussion of the formula (11) for the entropy of a quantum system 
with fixed spectrum. In the classical limit ni >> 1, the equation simplifies to 



S~mr({n°}). 



(17) 



S ~ In W . 



(18) 



(19) 
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In order to apply this formula, the notion of particles (which is required to be able to 
determine nj) must be well defined. However, when considering quantum fields in some 
external field {e.g., cosmological perturbations in an expanding background space-time), 
the notion of particles is not always well defined. It is hence desirable to have a formalism 
which generalizes the definition of entropy to situations where the number representation is 
not well defined. 

For large occupation numbers ni, the classical limit should give a good description of 
the dynamics of the system. It is therefore convenient to derive a formula for the entropy 
directly in terms of the classical field. In the cases when occupation numbers can be defined 
for this field, the new definition should reduce to (19). 

In the next section, we will give a definition of entropy of a classical field based on the 
theory of stochastic processes and show that in the region where both definitions of entropy 
are applicable they agree. 

IV. ENTROPY OF A CLASSICAL FIELD 

Formulas (11) and (19) for the entropy of a field are only applicable if the spectrum of 
occupation numbers is well defined. In order for this to be the case, there must be a well 
defined notion of particles for the field under consideration. 

As will be shown in Section 6, the description of cosmological perturbations and gravi- 
tational waves in the Universe can be reduced to the study of a scalar field <f(x,t) with a 
time dependent effective mass: [15,16] 

z" 

<p" - c 2 s A V (p = 0. (20) 

z 

Here, c s is the speed of propagation of perturbations. For gravitational waves c s — 1, whereas 
for cosmological perturbations in a Universe with hydrodynamical matter c s is the speed of 
sound. The time dependent function z depends on the system and on the background. For 
gravitational waves z — a, whereas z is a complicated function of the background parameters 
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in the case of cosmological perturbations (for details see Ref. 15 and Section 6). In the above 
a prime denotes differentiation time 77. 

The quantization of a scalar field obeying (20) is equivalent to the quantization of a 
scalar field in some external classical field. If z" / z = and c 2 s = const 7^ 0, then there is 
no coupling and the quantum theory for this field (in particular the notion of particle) is 
well defined. As will be shown in Section 6, this applies for both cosmological perturbations 
and gravitational waves in a radiation dominated Universe. However, this is not the general 
case. The ratio z" / z can be nonvanishing and c 2 may be zero. For example, for cosmological 
perturbations in a matter dominated Universe c s = 0. In this case the solutions of (20) do 
not have oscillatory character and it is not possible to define the notion of particles. Hence it 
is not possible to define occupation numbers and Equations (11) and (19) are inapplicable. 

However, if the perturbations are sufficiently large, the scalar field (p can be treated 
classically (in the case when occupation numbers are defined, the condition for classicality 
is rij >> 1). In order to define a notion of entropy valid in this case, we address the more 
general question of defining the entropy of a classical scalar field with an action which is 
quadratic in field variable and canonical momentum (see also Ref. 18). 

The source of the entropy is in this case the ignorance about the exact field configuration. 
A state of the system at some time t is specified by the values of the field (p(x,t) and its 
canonical momentum n(x,t) at all points x in space. We assume that all we know is the 
probability distribution P(ip(x), ir(x)) of the field and its canonical momentum, i.e., we view 
(p(x) as a stochastic classical field. 

The above situation is realized in many situations of interest in cosmology. For example, 
in inflationary Universe models, the amplification of scalar field fluctuations during the 
period of exponential expansion of the Universe and the nontrivial transition of quantum 
fluctuations to classical ones leads to a squeezed state [19,20] for the scalar field starting from 
the vacuum state at the beginning of inflation. The Gaussian random state is characterized 
by definite correlation functions (^p(x,t)ip(y,t)^, (n(x, t)ir(y, t)^ and (^ip(x,t)7r(y,t)^, where 
(q) stands for the ensemble average of the quantity q, (which coincides with the space average 
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of q for a spatially homogeneous stochastic process). 

If the initial state of the system is Gaussian, and if the Hamiltonian is quadratic, then 
time evolution will preserve the Gaussian character of the state. We will assume, as is the 
case for linear cosmological perturbations and gravitational waves, that the state is Gaussian 
at all times. Therefore, the probability distribution P(<p(x), tt(x)) can be expressed in terms 
of the above two-point correlation functions. Hence, also the entropy of the system must be 
expressible in terms of two point correlation functions. 

In the following, we will derive a general expression for the entropy of a stochastic 
Gaussian field in terms of its two-point correlation functions. 

Starting point of the analysis is formula (5) for the entropy in terms of the probability 
distribution. In our case, the continuous variable J stands for a point in phase space. To 
justify the choice of the measure in (5), we divide phase space (ip, ir) at every point x in 
space into units of volume 2-kTi (the smallest volume the fields can be localized in by the 
uncertainty principle) and calculate the probability AP that the fields lie in the bin Aj: 



Here, the integration ranges over fields (p(x) and n(x) which lie in bin Aj and T>{p(x) Vn(x) 
denotes the functional integral measure for a scalar field. 

Thus, from the analysis of Section 2 we conclude that (apart from an irrelevant constant), 
the entropy of the stochastic classical field is given by 




(21) 



S=- 



P((fi(x),%(x))lnP(tp(x),n(x))V(p(x)Vii (x) 



(22) 



For a Gaussian state, the probability distribution is 



P(<p, tt) = ^Lexp{-i (v^ipy + n x B*«Tr v + 2^7*%)} 



(23) 



where the normalization factor W, determined by 




(24) 
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is given by 

W = |exp j~ (^A^Vjy + ^5*%,, + 2ip x C xy n y ) J P^Ptt . (25) 

Here, we have used the short hand notation </?(x) = ip x and = A(x, y), and the Einstein 
"summation" convention for repeated indices 

p x A*» = J dxp(x)A(x,y) (26) 

is implied. For a homogeneous Gaussian state, the kernels A xy , B xy and C xy depend only 
on the difference of the arguments 

A xy = A(x, y) = A(x -y) = A{y - x) . (27) 

The kernel of the operator A~ l inverse to A will be denoted by A~y (defined as usual by 
A~lA zy = J rf 3 zA _1 (x, z)A(z,y) = 5 3 (x — y)). Note that the kernel C does not in general 
vanish since in general (p and ir are not statistically independent. A nonvanishing C reflects 
a correlation between (p and ir. 

Our goal now is to express the kernels A xy , B xy and C xy in terms of the two point corre- 
lation functions <p(y) ), ^7r(x)7r(y)^ and ((p(x)7r(y)^. As a first step, it is convenient to 
rewrite the distribution function P(tp, ir) in terms of new variables which are independent 

Cx = <P* + C zy A-^ z 

1X X = 7T X (28) 

The Jacobean of this transformation is 1 and hence 

VpVn = V(Vtt . (29) 
The probability distribution (23) in terms of the new variables ( and n is 

P(C,*) = ^expj-^c^c. + ^r^)} , (30) 

where 
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T xy = B xy - C xu A- u lC vy . (31) 
At this point, the correlation functions can be immediately expressed in terms of the kernels 

(CccCy) — A X y 
(7C x 7T y ) = 

<Cr%> = 0. (32) 

This can be seen either by direct functional integration, or by calculating the generating 
functional (characteristic functional) 

$( A r ) = J P(C, tt) exp {-UiC - U> x ) VCVtt (33) 

and taking second derivatives of it, e.g., 

(Cx(y) >= - c c \jC = jir =0 . (34) 
OJiOJy 

Substituting ( from (28) into (32) and solving the resulting set of equations we obtain 

Ky 1 = {<Px<Py) ~ {<Px'Xu){ir u 'ir v )~ 1 {ir v (py) 
B~y = (ir x ir y ) - (ir x ip v )(ip v ,ip v )~ 1 (ip v 'Ky) 

C xy = (VxKy) - (ir x 'Ku)(}PvFv)~ 1 (<Pv<Pv) ■ (35) 

Deriving the above formulas we took into account that for a spatially homogeneous Gaussian 
process the correlation functions depend only on the difference of the arguments. 

To calculate the entropy, we substitute (30) into the general formula (22) using the fact 
that the Jacobean of the transformation (28) is unity and obtain 

S = -j P(C,7r)mP(C,7r)PC^ 
= V5 3 (0) + \nW 

= V5 3 (0) + In/ exp {-± (C x A xy C y + n^n^VCVn 

= W 3 (0) + ^lndet(A- 1 r- 1 ) (36) 
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where V is the volume of space. Dropping the irrelevant constant contributions to the 
entropy and inserting (32) and (35) in the above, we get the following expression for the 
entropy in terms of correlation functions 

S = ^lndet((^ x ^)(7r 2 7r 2/ ) - (ip x n z ) (n z ip y )) = ^lndetP^ (37) 

Thus, the problem of calculating the entropy has been reduced to the evaluation of a 
determinant of the operator 

V*y = V(x-y)=J ({<p(xMz)){n(z)n(y)) - (<p(x)n(z)){n(z)<p(y)))d 3 z . (38) 

This determinant can be calculated by ( function regularization (see Appendix A). The 
result is 

(39) 
where 

V ± = J d 3 xe~^V(x) (40) 

is the spectral density of the operator V(x) = T>(x — y). Substituting (39) in (37) we obtain 
the following expression for the entropy per unit volume 

s r o 

s=y= J d 3 k\nV k 

= J d 3 k\n ((N 2 )(N 2 ) - (irfN 2 )) . (41) 

where we expressed the entropy in terms of the spectral density of correlation functions and 
omitted irrelevant contributions which do not depend on the spectrum of the scalar field. 

V. GENERAL COMMENTS 

In this section we shall focus on two issues: the connection between the two definitions 
of entropy given in Sections 3 and 4, and a further discussion of the origin of entropy. 



det V oc exp 



V / d 3 k\nV k 



16 



To concretize the analysis we consider a quantized free scalar field ip(x,r)) with time 
dependent effective mass. The field is assumed to start out in its initial vacuum state. As 
is well known, this state evolves into a squeezed state [19,20]. Such a state is highly excited 
in the sense that the expectation value of the number operator is large. 

If the mass is constant at the beginning and at the end, then the notion of particles is 
well defined for the in-state and for the out-state, and in the corresponding time intervals the 
field operator (p can be expanded either in terms of in-creation and annihilation operators 
a + and a~ or in terms of the corresponding out-operators c + and cT: 

= J J0r 2 (e**uf fa)*6* + e-^r^cj) (42) 

where u™{rj) and ul ut (rj) are the positive frequency mode functions in the in- and out-states 
respectively. For the particular case under consideration, the operators c£ and c^T are related 
to a k and a k via a Bogoliubov transformation 

c k = a k chr k — aZ k e 2llpk shr k 

4 = -a± h e- 2 ^shr k + atchr k . (43) 

The real functions r k (i]) and (p k (i]) are called squeeze parameter and squeeze angle respec- 
tively [21,22]. The initial state is taken to be the vacuum |0 > in defined by a^|0 >«„= for 
all k. 

The expectation value of the number of particles at late times in the k mode is 

< n k >=< in \4c k \0 in >= sh 2 r k . (44) 

Hence, for large values of the squeeze parameter r k , we should expect that the quantum field 
if can with good accuracy be described as a classical field ip d , since if r k ^> 1, the condition 
< n k >^> 1 to be in the region of applicability of the classical limit is satisfied. In this limit, 
the correlation functions of the classical field ipa should coincide with the corresponding 
expectation values of the operator if, e.g., 
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< <Pci(x,rj)<Pci{y,ri) >-< Qin\$(x,rj)<p(y,ri)\O in >=< (p(x,r})(p(y,r)) > . (45) 

Hence, in the classical limit both of our formulas for the entropy should be applicable and 
give the same result. In the following we show that this is indeed true. 

First of all, we need to calculate the correlation functions of (p in terms of the squeeze 
parameters. Taking into account that at late times (in the out-state) 

u out {v) „ e iu, kV ^ ^ = ^ - ^ (46) 

where m out is the mass in the out-phase, and using (43), we find the following expressions 
for the late time correlation functions [23] 

<<p(x,vMv,v)> = I 4^ e^-ld-L [2sh 2 r k + l-sh2r k cos25 k } 
<n(x,r ] )n(y,r ] )> = J ^ e *(*-y)^_ [2s h 2 r k + 1 + sh2r k cos 25 k ] 
< VU, vMy, V) > = J ^3 e*<*-S> \[l - ish2r k sin 25 k ] , (47) 
where the angle 5 k is 

h(v) = J dr](uj k (r]) - (p k ) . (48) 
Hence, it follows immediately that 

J d 3 z < (p(x)ip(z) >< it(z)n{y) > 

/d 3 h 1 
e iHx-y)L [{2sh 2 r k + l) 2 - sh 2 2r k cos 2 25 k ] (49) 

and 

J d 3 z < (p(x)ir(z) >< ir(z)(p(y) > 

r d 3 h 1 

= J 6 " ( ""- 4 [{2sh2rk + 1)2 " Sh22n C ° S2 26k] m 

Taking into account (45) we can substitute (49) and (50) into (38) to determine the 
entropy of the field in the classical limit. The two terms (49) and (50) evidently cancel 
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each other, giving vanishing entropy. But this is no surprise since we started in a pure state 
whose entropy must vanish and since the evolution of the system is unitary, thus preserving 
the entropy. The information about the final state is complete. 

To associate entropy with the final state we must neglect some information. Typically, 
this will be information which is very sensitive to any kind of perturbation, either of the 
system or of the state. In our example, the phases 5 k will depend sensitively on a pertur- 
bation, whereas the amplitudes will not. In the language of Section 3, the amplitude is the 
principal quantum number and the phases are averaged over. 

The nature of the perturbation mentioned above is a subject of independent analysis. 
There are several mechanisms; which one is realized will depend on the particular system 
under investigation. Interactions with other fields (which can be viewed as an environment) 
will induce stochasticity of the phases. Weak self interactions of the scalar field may also 
induce large changes in phases. Approximating the state of the system (e.g., neglecting 
decaying modes in examples in which the mass is constant at early and late times but 
changes in between) will have the same effect. 

Returning to our example, let us define the coarse grained entropy by at first averaging 
the two point correlation functions (47) over the phases 5 k and substituting the thus obtained 
"reduced" correlation functions into (38) to find the reduced operator V re( i which will be 

2% - V) = J J^ 3 ^ 1 + sh 2 r k )e^-y) . (51) 

Then, according to (41), the classical field definition of entropy gives 

s ^ J d 3 k\nsh 2 r k (52) 

in the classical limit sh 2 rk 3> 1. Taking into account (44) we obtain 

s ~ J d 3 k\nn k (53) 

for n k >> 1, in agreement with the result for the entropy obtained in Section 3 (see (19)). 

We conclude that in the cases in which both of our formulas for the entropy from Sections 
3 and 4 are applicable, the results coincide as they should. 
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VI. COSMOLOGICAL PERTURBATIONS 



Our goal is to apply the definition of nonequilibrium entropy developed in the previous 
sections to the gravitational field. Specifically, we will calculate the entropy of a stochastic 
background of gravitational waves and of linearized density perturbations. To set the stage, 
we briefly review the theory of linearized cosmological perturbations [24]. 

We consider linearized perturbations of metric and matter fields about a homogeneous 
and isotropic background cosmological model. There are three types of fluctuations — scalar, 
vector and tensor perturbations — which are distinguished by their transformation properties 
under background space coordinate changes. Vector modes decay and are irrelevant for 
cosmology. Hence, we shall focus on scalar modes (density perturbations) which couple to 
density and pressure and tensor modes (gravitational waves). 

Although it may at a first glance seem that both density perturbations and gravitational 
waves are described by several independent fields, the analysis can in both cases be reduced 
to the theory of a single scalar field [15,16]; and hence the formalism developed in previous 
sections to determine the entropy of a nonequilibrium dynamical system becomes applicable. 



Gravitational waves are linearized purely gravitational fluctuations about a homogeneous 
and isotropic background metric gffi . For simplicity we will consider a spatially flat Universe 
given by the invariant line element 



rj being conformal time and a{rj) denoting the scale factor. The metric perturbation 8g^ v = 
a^h^ for gravitational waves is transverse and traceless and satisfies h o = h 0i = 0. 

The action S gr for gravitational waves can be obtained by expanding the Einstein action 



A. Gravitational Waves 



ds 2 = a 2 (r))(dr) 2 — 8ijdx l dx^) , 



(54) 




3 



(55) 
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to second order in the perturbation variables, with the result 

S 9 r = ^ / d'xa 2 [hthf - KXe] , (56) 



where the derivative with respect to i] is denoted by a prime. Varying this action yields the 
following equation of motion for hy. 

h)„ + 2-h), - Ah) = . (57) 

(X 

In order to reduce the study of gravitational waves to the analysis of a single scalar field, 
we expand h % - in a Fourier series [15] 

h)(x, rj)=J ^ e ^-G)(k)a~ l u k ( V ) , (58) 

where Gj(k) is the polarization tensor of a gravitational wave with wave vector k. The mode 
functions Uk{rj) can be used to define a scalar field ip 

<P&v) = (T^) 1/2 / (Gm G mf /2 Mv) (59) 
in terms of which the action (56) becomes 



-If 



S ' g r — — I d X 



.2 a 

V ~ <P,i<P,i H V 

a 



(60) 



This action coincides with the action of a free scalar field with time dependent mass m{m 2 = 
—a" /a) in flat space-time. 

Based on the above equivalence between the gravitational radiation field and the scalar 
field ip(x,r])i we can use the general definitions of entropy developed in Sections 3 and 4 to 
define the entropy in gravitational radiation. This will be done in Section 7. 

B. Density Perturbations 

The theory of linearized density perturbations can also be reduced to the analysis of a 
single scalar field [25] . However, the reduction process is more complicated than in the case 
of gravitational waves. 

21 



Density perturbations are scalar type metric fluctuations which couple to energy density 
and pressure. At first sight, the most general scalar type metric perturbation Sg^x^rj) can 
be expressed in terms of four free functions. However, two of these functions describe pure 
gauge modes [26], i.e., inhomogeneities which correspond to a change of the background 
space-time coordinates. The easiest and most physical way to avoid gauge artifacts is to 
adopt a manifestly gauge invariant formalism [26] (for a pedagogical introduction see Ref. 16, 
for a comprehensive review see Ref. 15). In this approach, scalar type metric perturbations 
are characterized by two functions which are, via the linearized Einstein equations, coupled 
to matter inhomogeneities. The two gauge invariant functions <3>(x, rj) and ^(x, rj) can easily 
be identified by transforming to longitudinal gauge (the system of coordinates in which 5g^ u 
is diagonal): 

/2$ \ 

Sg^ = a 2 (61) 

V 2¥tfy J 

For scalar matter and for an ideal gas, $ = \& as a consequence of the % ^ j Einstein equation 
(for these forms of matter STij ~ Sij). 

At this point, the description of density perturbations has been reduced to prescribing 
a gauge invariant combination v of matter perturbation and metric fluctuations in terms of 
which the action for perturbations can be expressed in the form [27]: 



S v — — I d x 



z" 



v' - c 2 v iV j5 ij H v 2 



z 



(62) 



where c 2 = 1 for scalar field matter and c 2 = p/ p for ideal gas matter. The variable z{rj) is 
a combination of background dependent factors. For a perfect fluid and for a scalar field as 
matter 

z = ^ , P = H 2 -H>, (63) 
nc s 

where H = a' /a. 

All gauge invariant variables (like <E>) can be expressed in terms of the variable v via the 
Einstein equations. For example, the metric potential $ which characterizes the amplitude 
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of metric perturbations in longitudinal gauge (see (61)) is expressed in terms of v in the 
following manner 



(valid for both scalar field and hydrodynamical matter). 

In conclusion, we have been able to reduce the action for scalar metric perturbations 
to that of a free scalar field with mass m 2 = —z"/z. However, in contrast to the case of 
gravitational perturbations, the spatial gradient term has a prefactor c 2 . In the radiation 
dominated period of the evolution of the Universe this term implies that density perturba- 
tions propagate with the speed of sound c s = 1/V3. In the matter dominated period, c s = 0. 
This has important consequences for our ability to define the notion of "particle number" 
of a given field configuration for different equations state. 



In the previous section we demonstrated that the action for both gravitational waves 
and for density perturbations can be reduced to the action of a free scalar field. Hence 
the formalism of sections 3 and 4 can be used to define the nonequilibrium entropy of the 
gravitational field. 

In order to use the quantum definition of entropy of Section 3 we need a well defined 
notion of particles. For gravitational waves described by the action (60) and in the special 
case when a" = (which is realized in the radiation dominated period when airf) ~ 77) the 
mass term in (60) vanishes, and hence the notion of particles is well defined and the particle 
number remains constant. In contrast, during an inflationary period 0(77) = —l/(Hr)), and 
this leads to a negative time dependent effective square mass m 2 = — ^- in (60) which is 



Because of this time dependent mass, there will be in this case particle production and 




(64) 



VII. ENTROPY OF COSMOLOGICAL PERTURBATIONS 



2 _ f 

— 2 



(65) 



23 



corresponding increase in entropy. Focusing on modes with comoving wavenumber k, the 
time dependent mass induces an effective potential 



V effAf) = 




Hence, the increase in particle number is significant on scales which satisfy 

\/2 

k < -— = V2Ha, (67) 
V 

which (up to a factor of y/2) is exactly the condition for the wavelength k~ l a to be larger 
than the Hubble radius if -1 . Similarly, in the matter dominated period when airf) ~ rf 
there is a nonvanishing effective potential. In terms of 77 the potential takes precisely the 
form (65). Hence, (66) and (67) also apply in this case. 

In the following, we shall evaluate the entropy for the spectrum of gravitational waves pro- 
duced in an inflationary Universe. From the previous discussion, we see that the magnitude 
of the entropy is generated by "parametric amplification" [28] of the number of gravitons in 
each mode which occurs during inflation on scales larger than the Hubble radius. On scales 
which enter the Hubble radius after t eq , the time of equal matter and radiation, an additional 
amplification takes place during the matter dominated epoch. However, we emphasize that 
although the magnitude of the "potential" entropy is set by the inflationary phase, in order 
to get any nonvanishing entropy there needs to be a loss of correlations due to some coarse 
graining (see Section 5). 

The situation for density perturbations is similar. During the period of radiation 
domination, it follows from (6.12) that z" = 0. Hence, as in the case of gravitational 
waves, the notion of particles is well defined, the particle number is time independent, and 
hence the entropy per mode remains constant. During inflation, it follows from (63) that 
z" I z ~ a" I a = 2/r] 2 , and that therefore like for gravitational waves particle creation for 
modes with wavelengths larger than the sound horizon if -1 occurs, which leads to an in- 
crease in the occupation number of each mode. The analysis of density perturbations is 
more complex in the matter dominated period since c 2 s = 0. Hence no occupation number 
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can be denned. In this case we must use the classical framework of Section 4 in order to 
define the entropy. 

In the following, we will first calculate the entropy per mode of gravitational waves and 
density perturbations which were produced during inflation in a cosmological model in which 
the Universe is radiation dominated at late times and argue that the result for the more 
realistic case is the same. 



A. Gravitational Radiation 

To estimate the entropy of gravitational radiation produced during inflation, it is con- 
venient to express the expectation value < rik > of the number operator in each mode k 
(or, correspondingly, the squeeze parameter r^) in terms of the spectral density of the two 
point correlation function of the metric h l y Since this spectrum was calculated in 

the particular models we are interested in [29] , we can then use these results to estimate the 
entropy via formulas (52) or (53) (the result will be the same since on the scales of interest 
n k > 1). 

We can only justify the appearance of entropy for perturbations on scales smaller than 
the Hubble radius, since the mode functions do not oscillate on larger scales. Hence, when 
calculating the entropy in gravitational radiation at some late time, we will only consider 
scales smaller than the Hubble radius at that time. 

Combining (58) and (59) with the standard mode expansion of the quantum operator (p 
associated with ip, we obtain the following result for the operator hy. 



(2tt)3/2 (G™(*)G*(*)) 1/a 



(68) 



where c~l and are creation and annihilation operators respectively of particles with co- 
moving wave vector k at some late time and ul ut (rj) ~ e lkv for perturbations on scales smaller 
than the Hubble radius (kr/ 3> 1). 
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The spectrum Sh(k) of gravitational radiation is defined in terms of the two point function 
of hj by 

(0 in \h)(x,r ] )M(x + r,r ] )\0 m ) = J^ S -^l\S h (k)\ 2 (69) 

with r = (r) and k = \k\ and where \0 in > is the initial vacuum state defined by %\0i n >= 0. 
On the other hand, this two point function can be evaluated in terms of occupation numbers 
using (68) 

(^(x,rj)U(x + r,rj)\0) = |V 2 f f 5^fc 2 (2 < n k > +1) (70) 

where we took into account that < in \c^c^\0 in >=< n k >. Comparing (69) and (70) yields 

1 2tt|^(A;)| 2 

2< " 1>+1 = #W' (71) 

Equation (71) can be applied to calculate the entropy of gravitational radiation in any 
cosmological model. Given the spectrum Sh(k), the occupation numbers < n k > are deter- 
mined for each mode by (71), and the entropy per mode follows from (53). 

To be specific, we evaluate the entropy in an inflationary Universe. The spectrum of 
gravitational radiation originating in quantum fluctuations during the phase of exponential 
expansion has been calculated many times [29] (for an explicit derivation using the notation 
of this paper see Ref. 15). The result is 

W = 4=- (72) 

where to is the present time and tn corresponds to the end of inflation. z eq is the redshift 
at the time of equal matter and radiation. The top line corresponds to scales which enter 
the Hubble radius after t eq , the bottom to those which enter during the period of radiation 
domination. Hence, from Equation (71) 



2<n k >+l 



6nk 2 



(toA:)" 4 t^ 1 < k < t^z^ 
(tok)- 2 z-i *VV < k < fo V /4 (&) 1/2 > 



~eq ~eq "U "U ~eq Kt R > 
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H being the Hubble expansion rate during the period of inflation. 

Choosing H = 10 13 GeV, a value for which fluctuations from inflation have the right 
order of magnitude to seed galaxies [30], and comparing the entropy Sk per mode on galactic 
scales k~ x ~ lOMpc, we conclude from (73) that 

s fc ~1001nl0. (74) 

Formula (74) can also be interpreted as giving the entropy in a volume V = k~ 3 of 
gravitational waves with wave number of the order k. This quantity can be compared with 
the statistical fluctuations of the entropy of the cosmic microwave background (CMB). These 
fluctuations Ascmb(^) scale as 

As C mb(A;)~(A;A 7 ) 3 / 2 , (75) 

where A 7 is the characteristic wavelength of the CMB. Hence, for large k~ l (such as the 
scales mentioned above), the entropy in gravitational waves exceeds that in the statistical 
fluctuations of the CMB. This reflects the result that on cosmological distance scales the 
fluctuations produced by inflation are much larger than the Poisson noise in the background 
fields. 

However, the total entropy density for the gravitational background is smaller than that 
of the CMB for which 

Ait 

Scmb^—T*. (76) 
From (53) it follows that the entropy density in gravitational radiation is 

S 9r * fkl (77) 

where k c is determined by 



n(k c ) ~ 1 . (78) 



From (73) it follows that 
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~ *o"V /4 (£) 1/2 (79) 

and hence 

U (80) 

Comparing (77) and (80) we see that the total entropy density in gravitational waves is 
suppressed compared to the entropy of the CMB by a factor (H/m p i) 3 ^ 2 . Nevertheless, as 
seen above, on large length scales, gravitational radiation dominates over the fluctuations 
of the entropy of the CMB. 



B. Density Perturbations 



The approach for calculating the entropy of density perturbations follows what was done 
above for gravitational waves. Starting point is the expansion of the operator ip associated 
with the scalar field v of (62) [which contains all the information about density perturbations] 
in terms of late time creation and annihilation operators c\ and c^T respectively: 

1 r d 3 k 



e l ^v° k ut (v)^ + e-^vr(v)4 



ik-x„.outi 



(81) 



V2J (2tt) 3 / 2 

To simplify the consideration and to justify the notion of entropy, we will estimate the 
entropy on scales smaller than the Hubble radius at late times, assuming that in this late 
time interval the Universe is radiation dominated. In this case, the notion of particles is 
unambiguous since the mode functions Vk(rj) take the form 

1 



(82) 



with uj = c s k = kj V3. 

Using the relation (64) between the gauge invariant relativistic potential $ and the scalar 
field v valid when c 2 s ^ we obtain [15] 

d 3 k 



3 , B 1/2 
^( x n) = (-) l l 2 l'— , 
{3L,V) V a J (2tt) 3 / 2 
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(83) 



with 

* = *t<T>'- (84) 

As was done previously in the case of gravitational waves, the next step is to derive the 
relation between the spectrum 8<t>(k) of density perturbations 

(0 m \mvML, v )\0 m ) = 1°° f^Mk)] 2 (85) 

and the occupation number < n k > defined with respect to the creation and annihilation 
operators introduced in (81). Using (83) it follows that 

/ - \ 3 ft r d 3 k 

{0 in \mvML,ri)\0 in ) = J j-^(2 < n k > +l)«J«* e *= . (86) 

Making use of (82) and (84), and evaluating z during the period of radiation domination, 
we obtain 



0^(0,77)%, 7?) |0 m ) = ^IVV 2 ^^- 1 ^ (87) 

(kr]) 2 \ 



(2tt)= 

x (2 < n k > +l)k~ 2 11 + 



Comparing (85) and (87) yields 



2 < n k > +1 = ^(^) 2 M 2 ^ 2 (l + ^) 1 Mk)\* , (88) 

which expresses the occupation numbers in terms of the spectrum of the relativistic potential 
for density perturbations. 

The entropy for density perturbations can now be determined by combining (88) and 
(53). To be specific, we evaluate the entropy per mode in a model of chaotic inflation [31] 
with potential 

V(<p) = \m\ 2 . (89) 

In this case, the spectrum of density perturbations immediately after inflation on scales 
which are larger than the Hubble radius is given by [15] 
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where A 7 is the characteristic wavelength of the CMB. To obtain the late time spectrum, the 
decay of the amplitude of $ on scales inside the Hubble radius must be taken into account. 
Assuming that the Universe is radiation dominated after inflation we obtain [15] 



'^^ lnln UJUJ (91) 

for ki] > 1 at time to- 
Inserting (91) into (88) yields the following result for kr] >> 1: 

2 < n k > +1 ~ (mt ) 2 In 2 (J^J (^j . (92) 

Up to the logarithmic factor, this result agrees with the corresponding result (73) for gravi- 
tational waves. 

For m ~ 10 13 GeV (the upper bound on m from constraints on the anisotropy of the 
CMB) we hence obtain the same entropy density per mode 

s fc ~1001nl0. (93) 

We conclude that the entropy per mode of density perturbations on large scales (A 3> A 7 ), 
in particular on scales of galaxies, clusters and large-scale structure, exceeds the statistical 
fluctuations of the entropy of the CMB. This supports the important role of the entropy of 
the gravitational field in the galaxy formation process. 

The quantum approach of calculating the entropy of density perturbations breaks down 
during the matter dominated era. However, based on the considerations of Section 5, it is 
easy to extend the analysis. 

As discussed in Section 4, the classical definition (41) can easily be applied during the 
epoch of matter domination. The results obtained above will not change significantly. How- 
ever, there are some interesting questions concerning coarse graining and time dependence 
of the entropy in a matter dominated Universe which we shall consider elsewhere. 
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Formulas (71) and (88) can be used to calculate the entropy of gravitational waves and 
density perturbations in any cosmological model in which the spectra 5h(k) and deltaq>(k) 
are known. In particular, the entropy of the gravitational field in topological defect models 
of structure formation [14] can easily be determined. 

VIII. CONCLUSIONS 

We have presented two general definitions of nonequilibrium entropy and applied them 
to calculate the entropy in gravitational radiation and to give a measure of the entropy of 
linear density fluctuations and gravitational waves in a Friedmann Universe. 

Our first definition of entropy is based on the microcanonical ensemble and is applicable 
to systems with well defined occupation numbers. The origin of the entropy is coarse grain- 
ing: ignoring correlations in the form of information about quantum numbers other than 
the principal quantum number which is usually taken to be the energy. 

The second definition of entropy applies to any stochastic classical field and expresses 
the entropy in terms of two point correlation functions. The physical origin of entropy in 
this case is also due to coarse graining. We have shown that the entropy of scalar fields in 
an expanding Universe satisfies the second law of thermodynamics. Any increase in entropy 
during Hamiltonian evolution is a consequence of coarse graining. 

We have used the gauge invariant theory of cosmological perturbations to give a consis- 
tent and unified definition of entropy of cosmological perturbations. On scales of galaxies 
and larger, this entropy is larger than the statistical fluctuations in the entropy of CMB 
photons on these scales. Hence, this entropy is important for structure formation in the 
Universe. However, the total entropy in density perturbations and in gravitational waves is 
smaller than the total entropy of the CMB. 

It is our hope that the methods presented here can be used in many different situations. 
In particular, they might allow a definition of entropy of density perturbations beyond linear 
theory. 
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Calculation of the Determinant of V(x — y) ~ V xy 
The determinant of the operator V(x — y) m V xy arising in (38) can be calculated using 
the ^-function method [32]. More generally, consider an operator V xy with a discrete set of 
positive real eigenvalues Oj and eigenfunctions 



V xy ff = J d 3 yV(x - y)f\y) = a t 5 xy ff . (94) 
This set of operators includes any operator with positive spectral density 

= J d 3 ze- ik ^V{z) (95) 



which has support in a finite volume V, i.e., V(z) = if z V. 
The ^-function associated with such an operator is 



C^)=£^, (96) 



where the sum extends over all nonzero eigenvalues. It follows that 

&(0) = ^^Uo = -E ln ^~ s % =0 = -ln(H^) (97) 

i 

and hence 
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detV = Hidi = e^ (0) . 



(98) 



Thus, the calculation of the determinant of V has been reduced to the evaluation of Cz>(0)- 
Let us now introduce the heat kernal G(x,y,r) associated with V, 

G(x,y,r) = J2e-^fWfW , (99) 

i 

which in the case under consideration depends only on x — y and r and satisfies the equation 

/ V(x - z)G(z - y)d 3 z = _?^_kll (ioo) 
with boundary condition 

G(x-y,0) = 5(x-y), (101) 

a consequence of the completeness of the set of eigenfunctions. It is easy to check by explicit 
integration that 

Cv(s) = ^ / drr 3 - 1 / d 3 xG(x,x,r) . (102) 
1 [s) Jo J 

Thus, in order to compute det V we need to solve Eq. (A7) for G(x, y, r) given the 
boundary condition (A8). It is convenient to work in Fourier space where Eq. (A7) takes 
the form 

V(k)G(k,r) = -^-(G(k,r)) (103) 

with boundary condition 

G(k,0) = l, (104) 

where 

G(k,r) = J G{z,T)e lk ^d 3 z. (105) 
As a result we obtain the following solution of (A7): 
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G{x -y,r) = J d^ke^e^-v) . (106) 
Substituting (A13) into (A9) on finds 

( v ( s ) = V f d 3 ke~ slnV ® (107) 

and correspondingly 

det£> = exp (v J \nV(k)d 3 kj (108) 
where V is the volume of the support of V. 
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